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Abstract 

The  functional  organization  of  the  cerebral  cortex  is  modified  dramatically  by 
sensory  experience  during  early  postnatal  life.  The  basis  of  these  modifications 
is  a  type  of  synaptic  plasticity  that  may  also  contribute  to  some  forms  of  adult 
learning.  The  question  of  how  synapses  modify  according  to  experience  has 
been  approached  by  determining  theoretically  what  is  required  of  a  modification 
mechanism  to  account  for  the  available  experimental  data  in  the  developing 
visual  cortex.  The  resulting  theory  states  precisely  how  certain  variables  might 
influence  synaptic  modifications.  This  insight  has  led  to  the  development  of  a 
biologically  plausible  molecular  model  for  synapse  modification  in  the  cerebral 


cortex. 
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Although  Aristotle  identified  heart  as  the  seat  of  intellect,  reserving  for  brain  the 
function  of  cooling  the  head,  it  is  now  generally  believed  that  it  is  brain  that  is  the 
source  of  thought,  the  location  of  memory,  the  physical  basis  of  mind,  consciousness 
and  self-awareness:  all  that  make  us  distinct  and  human.  In  recent  years  it  has 
become  increasingly  fashionable  to  treat  this  complex  system  as  a  neural  network:  an 
assembly  of  neurons  connected  to  one  another  by  synaptic  junctions  that  serve  to 
transmit  information  and  possibly  to  store  memory. 

Since  the  contents  of  memory  must  depend  to  some  extent  on  experience,  the 
neural  network  and,  in  particular,  the  synapses  between  neurons  cannot  be 
completely  determined  genetically.  This  evident  reasoning  has  led  to  much 
discussion  about  possible  modification  of  synapses  between  neurons  as  the 
physiological  basis  of  learning  and  memory  storage.  To  properly  function,  neural 
network  models  require  that  vast  arrays  of  synapses  have  the  proper  strengths.  A 
basic  problem  becomes  how  these  synapses  adjust  their  weights  so  that  the  resulting 
neural  network  shows  the  desired  properties  of  memory  storage  and  cognitive 
behavior. 

The  problem  can  be  divided  into  two  parts.  First,  what  type  of  modification  is 
required  so  that  in  the  course  of  actual  experience  the  neural  network  arrives  at  the 
desired  state?  The  answer  to  this  question  can  be  illuminated  by  mathematical 
analysis  of  the  evolution  of  neural  networks  using  various  learning  hypotheses.  The 
second  part  of  this  problem  is  to  find  experimental  justification  for  any  proposed 
modification  algorithm  A  question  of  extraordinary  interest  is:  What  are  the  biological 
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mechanisms  that  underlie  the  nervous  system  modification  that  results  in  learning, 
memory  storage,  and  eventually  cognitive  behavior? 

One  experimental  model  that  appears  to  be  well-suited  for  the  purpose  of 
determining  how  neural  networks  modify  is  the  cat  visual  cortex.  The  modification  of 
visual  cortical  organization  by  sensory  experience  is  recognized  to  be  an  important 
component  of  early  postnatal  development  (1).  Although  much  modifiability 
disappears  after  the  first  few  months  of  life,  some  of  the  underlying  mechanisms  are 
likely  to  be  conserved  in  adulthood  to  provide  a  basis  for  learning  and  memory.  We 
have  approached  the  problem  of  experience-dependent  synaptic  modification  by 
determining  theoretically  what  is  required  of  a  mechanism  in  order  to  account  for  the 
experimental  observations  in  visual  cortex.  This  process  has  led  to  the  formulation  of 
hypotheses,  many  of  which  are  testable  with  currently  available  techniques.  In  this 
article  we  illustrate  how  the  interaction  between  theory  and  experiment  has  suggested 
a  possible  molecular  mechanism  for  the  experience-dependent  modifications  of 
functional  circuitry  in  the  mammalian  visual  cortex. 

The  Experimental  Model 

Neurons  in  the  primary  visual  cortex,  area  17,  of  normal  adult  cats  are  sharply 
tuned  lor  the  orientation  of  an  elongated  slit  of  light  and  most  are  activated  by 
stimulation  of  either  eye  (2)  Both  of  these  properties  --  orientation  selectivity  and 
bmocularity  -  depend  on  the  type  of  visual  environment  experienced  during  a  critical 
period  of  early  postnatal  development.  We  believe  that  the  mechanisms  underlying 
the  experience-dependent  modification  of  both  receptive  field  properties  are  likely  to 
be  identical.  However,  for  the  sake  of  clarity,  we  concentrate  primarily  on  the 
modification  of  binocular  connections  in  striate  cortex. 
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The  majority  of  binocular  neurons  in  the  striate  cortex  of  a  normal  adult  cat  do  not 
respond  with  equal  vigor  to  stimulation  of  either  eye;  instead  they  typically  display  an 
eye-preference.  To  quantify  this  impression  Hubei  and  Wiesel  (2)  originally  separated 
the  population  of  recorded  neurons  into  seven  ocular  dominance  (OD)  categories  (Fig. 
1 ).  The  OD  distribution  in  a  normal  kitten  or  adult  cat  shows  a  broad  peak  at  group  4, 
which  reflects  a  high  percentage  of  binocular  neurons  in  area  17  (Fig.  la).  This 
physiological  assay  of  ocular  dominance  has  proved  to  be  an  effective  measure  of  the 
state  of  functional  binocularity  in  the  visual  cortex. 

(Fig.  1  here) 

Monocular  deprivation  (MD)  during  the  critical  period  [extending  from 
approximately  3  weeks  to  3  months  of  age  in  the  cat  (3)]  has  profound  and 
reproducible  effects  on  the  functional  connectivity  of  striate  cortex.  Brief  periods  of  MD 
will  result  in  a  dramatic  shift  in  the  OD  of  cortical  neurons  such  that  most  will  be 
responsive  exclusively  to  the  open  eye  (Fig.  1b).  The  ocular  dominance  shift  after  MD 
is  the  best  known  and  most  intensively  studied  type  of  visual  cortical  plasticity. 

When  the  MD  is  begun  early  in  the  critical  period,  the  OD  shift  can  be  correlated 
with  anatomically  demonstrable  differences  in  the  geniculocortical  axonal  arbors  of  the 
two  eyes  (4,  5).  However,  MD  initiated  late  in  the  critical  period  (6)  or  after  a  period  of 
rearing  in  the  dark  (7)  will  induce  clear  changes  in  cortical  OD  without  a  corresponding 
anatomical  change  in  the  geniculocortical  projection.  Long-term  recordings  from 
awake  animals  also  indicate  that  ocular  dominance  changes  can  be  detected  within  a 
few  hours  of  monocular  experience  (8),  which  seems  too  rapid  to  be  explained  by  the 
formation  or  elimination  of  axon  terminals.  Moreover,  deprived-eye  responses  in 
visual  cortex  may  be  restored  within  minutes  under  some  conditions  [such  as  during 
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intracortical  bicuculline  administration  (9)]  which  suggests  that  synapses  deemed 
functionally  "disconnected"  are  nonetheless  physically  present.  Therefore  it  is 
reasonable  to  assume  that  changes  fn  functional  binocularity  are  not  only  explained 
by  adjustments  of  the  terminal  arbors  of  geniculocortical  axons,  but  also  by  changes  in 
the  efficacy  of  individual  cortical  synapses. 

The  consequences  of  binocular  deprivation  (BD)  on  visual  cortex  stand  in  striking 
contrast  to  those  observed  after  MD.  While  7  days  of  MD  during  the  second  postnatal 
month  leave  few  neurons  in  striate  cortex  responsive  to  stimulation  of  the  deprived 
eye,  most  cells  remain  responsive  to  visual  stimulation  through  either  eye  after  a 
comparable  period  of  BD  (10).  Thus,  it  is  not  merely  the  absence  of  patterned  activity 
in  the  deprived  geniculocortical  projection  that  causes  the  decrease  in  synaptic 
efficacy  after  MD. 

Stent  (11)  suggested  that  the  crucial  difference  between  MD  and  BD  is  that  only  in 
the  former  instance  are  cortical  neurons  active.  This  idea  was  put  to  the  test  in  an 
ingenious  series  of  experiments  by  Singer  and  colleagues  in  which  kittens  were 
presented  with  visual  stimuli  that  created  an  imbalance  in  the  presynaptic 
geniculocortical  fiber  activity  from  the  two  eyes,  but  that  were  ineffective  in  driving 
cortical  neurons  (12,  13).  Under  these  conditions,  there  was  no  shift  in  cortical  ocular 
dominance.  Thus,  on  a  purely  descriptive  level,  it  appeared  that  postsynaptic 
activation  was  a  necessary  condition  for  synaptic  modifications  to  occur  in  the  visual 
cortex.  This  simple  rule  resembles  Hebb's  postulate  of  learning  (14)  that  states  that 
synaptic  efficacy  should  increase  only  when  the  pre-  and  postsynaptic  elements  are 
concurrently  active.  To  account  for  the  effects  of  MD  in  striate  cortex,  Stent  added  the 
complementary  statement  that  postsynaptic  activity  is  also  a  necessary  condition  for 
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the  weakening  of  inactive  synapses.  According  to  this  idea,  postsynaptic  activation  is 
necessary  for  all  synaptic  modifications  and  the  sign  of  the  change  (+  or  -)  is 
dependent  on  the  amount  of  presynaptic  activity. 

Subsequent  work  has  suggested,  however,  that  the  generation  of  action  potentials 
in  a  cortical  neuron  does  not  ensure  that  ocular  dominance  modifications  will  occur 
after  MD  (15).  This  has  led  to  the  idea  that  there  is  a  critical  level  of  postsynaptic 
activition  that  must  be  reached  before  experience-dependent  modifications  will  occur, 
and  that  this  threshold  is  higher  than  the  depolarization  required  for  soma-spikes  (16). 
Singer  (17)  has  recently  proposed  a  tentative  mechanism  that  could  account  for  this 
type  of  modification  scheme.  Experience-dependent  modifications  do  not  normally 
occur  in  the  visual  cortex  of  anesthetized  kittens  (18).  However,  shifts  of  ocular 
dominance  can  be  induced  under  anesthesia  when  cortical  excitability  is  raised  by 
pairing  monocular  visual  stimulation  with  electrical  stimulation  of  the  midbrain  reticular 
formation  (19).  Only  under  these  conditions  can  visual  stimulation  evoke  decreases  in 
the  extracellular  calcium  ion  concentration  as  measured  with  ion  sensitive  electrodes 
(20).  These  findings  led  Singer  to  suggest  that  the  threshold  level  of  postsynaptic 
activation  required  for  synaptic  modification  is  related  to  voltage-dependent  calcium 
entry  into  cortical  dendrites.  According  to  this  hypothesis,  free  calcium  in  the  dendrite 
acts  as  a  second  messenger  to  trigger  the  molecular  changes  required  for  a 
modification  of  synaptic  efficacy  to  occur. 

This  idea  of  synaptic  change  being  dependent  on  some  supra-threshold  output  of 
the  postsynaptic  neuron  can  account  for  many  of  the  observed  results  in  striate  cortex 
after  different  types  of  visual  deprivation.  However,  there  are  several  examples  of 
synapse  modification  in  visual  cortex  that  will  occur  with  little  or  no  evoked  activity  in 
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cortical  neurons.  For  instance,  if  after  a  brief  period  of  MD  the  deprived  eye  is  allowed 
to  see  and  the  experienced  eye  is  sutured  closed  (known  as  a  reverse  suture 

4 

experiment),  then  there  is  a  robust  OD  shift  back  to  the  newly  opened  eye  (4,  13,  21). 
This  shift  occurs  despite  the  fact  that,  at  the  time  of  the  reversal,  the  unsutured  eye 
was  functionally  disconnected  from  the  striate  cortex.  Moreover,  if  impulse  activity  from 
one  eye  is  completely  silenced  with  intraocular  tetrodotoxin  and  the  other  eye  sutured 
closed,  then  an  OD  shift  can  sometimes  occur  in  favor  of  the  sutured  eye  even  though 
this  eye  is  deprived  of  the  visual  patterns  required  to  drive  cortical  neurons  (22). 

Finally,  the  ocular  dominance  shift  produced  by  a  period  of  MD  will  disappear,  as  will 
orientation  selectivity,  if  the  animal  is  subsequently  binoc' Marly  deprived  (23).  This 
change  in  selectivity  occurs  under  conditions  where  visual  cortical  neurons  are 
presumably  inactive.  Hence,  it  is  clear  that  relative  postsynaptic  inactivity  does  not 
preclude  synapse  modifications  under  all  conditions.  Thus,  the  Hebb-Stent 
hypothesis  cannot  account  for  the  observed  data  without  making  further  assumptions. 

Work  over  the  past  several  years  has  led  to  an  alternative  theoretical  solution  to  the 
problem  of  visual  cortical  plasticity  (24).  According  to  Cooper,  et  al.  (CLO,  ref.  25), 
when  a  cortical  neuron  is  depolarized  beyond  a  "modification  threshold",  0M,  then 
synaptic  efficacies  change  along  lines  envisaged  by  Hebb.  However,  when  the  level 
of  postsynaptic  activity  falls  below  0^  then  synaptic  strengths  decrease.  Thus,  in  this 
model  the  sign  of  a  synaptic  change  is  a  function  primarily  of  the  level  of  postsynaptic 
activity.  Analysis  by  CLO  confirmed  that  such  a  modification  scheme  could  lead  to  the 
development  of  selectivity  that  is  appropriate  for  the  input  environment.  However, 
these  authors  also  noted  that  a  fixed  modification  threshold  leads  to  certain  technical 
problems.  For  instance,  if  the  postsynaptic  response  to  ail  patterns  of  input  activity 
slipped  below  6^  (as  might  occur  during  binocular  deprivation),  then  the  efficacy  of  all 
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synapses  would  decrease  to  zero.  Bienenstock,  Cooper  and  Munro  (BCM,  ref.  26) 
solved  this  problem  by  allowing  the  modification  threshold  to  float  as  a  function  of  the 

A 

averaged  activity  of  the  cell.  With  this  feature,  the  theory  can  successfully  account  for 
virtually  all  the  types  of  modification  that  have  been  observed  in  kitten  striate  cortex 
over  the  past  20  years.  This  theory  is  outlined  in  more  detail  in  the  next  section;  then 
we  shall  return  to  the  question  of  possible  mechanisms. 

Theoretical  Analysis 

Cortical  neurons  receive  synaptic  inputs  from  many  sources.  In  layer  IV  of  visual 
cortex  the  principal  afferents  are  those  from  the  lateral  geniculate  nucleus  (LGN)  and 
from  other  cortical  neurons.  This  leads  to  a  complex  network  that  has  been  analyzed 
in  several  stages.  In  the  first  stage,  consider  a  single  neuron  with  inputs  from  both 
eyes  (Fig.  2a).  Here  d  represents  the  level  of  presynaptic  geniculocortical  axon 
activity,  m  the  synaptic  transfer  function  ("synaptic  strength”  or  "weight"),  and  q  the 
level  of  postsynaptic  activity  of  the  cortical  neuron.  These  parameters,  their  symbolic 
notation,  and  their  possible  physiological  measures  are  shown  in  Table  1.  The  output 
of  this  neuron  (in  the  linear  region)  can  be  written: 

C  =  m1  •  d1  +  mr  •  dr  [1] 

which  means  that  the  neuron  firing  rate  (or  dendritic  depolarization)  is  the  sum  of  the 
inputs  from  the  left  eye  multiplied  by  the  left-eye  synaptic  weights  plus  the  inputs  from 
the  right  eye  multiplied  by  the  right-eye  synaptic  weights.  Thus,  the  signals  from  the 
left  and  right  eyes  are  integrated  by  the  cortical  neuron  and  determine  its  level  of 
depolarization  (output)  at  any  instant. 


(Fig.  2  here) 
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The  crucial  question  becomes:  how  does  m  change  in  time  according  to 
experience?  According  to  the  BCM  theory  (26),  m  modifies  as  a  function  of  local, 

i 

quasi-local  and  global  variables.  Consider  the  synaptic  weight  of  the  jth  synapse  on  a 


neuron,  m:  (Fig.  2b).  This  synapse  is  affected  by  local  variables  in  the  form  of 


information  available  only  through  the  synapse,  such  as  the  presynaptic  activity 
levels  (dj )  and  the  efficacy  of  the  synapse  at  a  given  instant  in  time  (mj  (t)).  Quasi¬ 
local  variables  represent  information  that  is  available  to  the  jth  synapse  through 
intracellular  communication  within  the  same  cell.  These  include  the  instantaneous 
firing  rate  (or  dendritic  depolarization)  of  the  cell  (c),  the  time  averaged  firing  rate  © 
and  the  potentials  generated  at  neighboring  synaptic  junctions  ((dm)k,  |,  m,  ...)•  Finall'. 

global  variables  (designated  X.  X,  Zin  Table  1)  represent  information  that  is  available 
to  a  large  number  of  cortical  neurons,  including  the  neuron  receiving  the  synapse. 
These  variables  might  include  the  presence  or  absence  of  "modulatory" 
neurotransmitters  such  as  acetylcholine  and  norepinephrine  (15)  or  the  averaged 
activity  of  large  numbers  of  cortical  cells  (16). 


We  can  delay  consideration  of  the  global  variables  by  assuming  that  they  act  to 
render  cortical  synapses  modifiable  or  non-modifiable  by  experience.  In  the  "plastic 
state",  the  BCM  algorithm  for  synaptic  modification  is  written: 


dmj/dt  =  d(£,  £)  di 


[2] 


so  that  the  strength  of  the  j,h  synaptic  junction,  mj,  changes  its  value  in  time  as  a 


function,  <>,  of  the  quasi-local  states,  £  and  £,  and  as  a  linear  function  of  the  local 


variable  dj.  The  crucial  function,  <j>,  is  shown  in  Fig.  3. 


(Fig.  3  here) 
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One  significant  feature  of  this  model  is  the  change  of  sign  of  0  at  the  modification 
threshhold,  0^.  When  the  input  activity  of  the  jth  synapse  (<^)  and  p  are  both 
concurrently  greater  than  zero  (27)  then  the  sign  of  the  synaptic  modification  is  positive 
and  the  strength  of  the  synapse  increases,  p  >  0  when  the  output  of  the  cell  exceeds 
the  modification  threshold  (this  type  of  synaptic  modification  is  "Hebbian").  When  di  is 
positive  and  p  is  less  than  zero,  then  the  synaptic  efficacy  weakens,  p  <  0  when  g  < 

0M.  Thus,  "effective"  synapses  will  be  strengthened  and  "ineffective"  synapses  will  be 
weakened,  where  synaptic  effectiveness  is  determined  by  whether  or  not  the 
presynaptic  pattern  of  activity  is  accompanied  by  the  simultaneous  depolarization  of 
the  target  dendrite  beyond  the  modification  threshold,  0M.  Since  the  depolarization  of 
the  target  cell  beyond  0M  normally  requires  the  synchronous  activation  of  converging 
excitatory  synapses,  this  type  of  modification  will  "associate"  those  synapses  that  are 
concurrently  active  by  increasing  their  effectiveness  together. 

Another  significant  feature  of  this  model  is  that  the  value  of  the  modification 
threshold  (0M)  is  not  fixed,  but  instead  varies  as  a  non-linear  function  of  the  average 
output  of  the  cell  (g).  In  a  simple  situation: 

0M  -  (£)2  [3] 

By  allowing  0M  to  vary  with  the  average  response  in  a  faster-than-linear  fashion,  the 
response  characteristics  of  a  neuron  evolve  to  maximum  selectivity  starting  at  any 
level  within  the  range  of  the  input  environment.  It  is  also  this  feature  that  provides  the 
stability  properties  of  the  model  .so  that,  for  instance,  simultaneous  pre-  and 
postsynaptic  activity  at  a  continued  high  level  do  not  continue  to  increase  the  synaptic 
strength. 


Bear,  Cooper  &  Ebner 


12 


Now  consider  the  situation  of  reverse  suture  where  the  right,  formerly  open  eye  is 

.1 

closed  and  the  left,  formerly  sutured  eye  is  reopened.  The  output  of  a  cortical  neuron 
in  area  17  approaches  zero  just  after  the  reversal  since  its  only  source  of  patterned 
input  is  through  the  eye  whose  synapses  had  been  functionally  disconnected  as  a 
consequence  of  the  prior  MD.  However  as  £  diminishes,  so  does  the  value  of  0^  . 
Eventually,  the  modification  threshold  attains  a  value  below  the  small  output  that  is 
evoked  by  the  stimulation  of  the  weak  left  eye  synapses.  Now  the  efficacy  of  these 
"functionally  disconnected"  synapses  will  begin  to  increase  because  even  their  low 
response  values  exceed  0M.  As  these  synapses  strengthen  and  the  average  output  of 
the  cell  increases,  0^  again  slides  out  until  it  overtakes  the  new  left-eye  response 
values.  At  the  same  time,  the  efficacy  of  the  right-eye  synapses  continually  decreases 
because  their  response  values  remain  below  the  modification  threshold.  In  its  final 
stable  state,  the  neuron  is  responsive  only  to  the  newly  opened  eye,  and  the  maximum 
output  to  stimulation  of  this  eye  equals  0M. 

So  far,  the  discussion  has  been  limited  to  an  idealized  single  neuron  whose  inputs 
arise  only  from  the  lateral  geniculate  nucleus.  The  second  stage  of  the  theoretical 
analysis  requires  that  relevant  intracortical  connections  be  incorporated  into  the 
model.  Consider  a  simple  network,  illustrated  in  Fig.  4,  in  which  inhibitory  and 
excitatory  cortical  neurons  receive  input  from  the  LGN  and  from  each  other.  In  a 
network  generalization  of  equation  1,  the  integrated  output  of  the  i1^  neuron  may  be 
written: 
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where  the  term  X  Ly  £j  is  the  sum  of  the  output  from  other  cells  in  the  network 
multiplied  by  the  weight  of  their  synapses  on  the  ith  cell. 

A 

(Fig.  4  here) 

The  influence  of  this  network  on  the  synaptic  modifications  of  the  ith  neuron  may  be 
analyzed  using  a  mean  field  approximation  (28).  Assuming  only  that  the  nei  influence 
of  the  intracortical  connections  is  inhibitory  [(XLjj  £j)  <  0],  this  work  has  proven  that  a 

neuron  will  evolve  to  an  asymptotically  stable  state  that  is  appropriate  for  a  given 
visual  environment  (ie.,  in  agreement  with  what  has  been  observed  experimentally). 
Importantly,  this  occurs  without  assuming  any  modification  of  the  inhibitory  synapses  in 
the  network. 

There  is  an  interesting  consequence  of  assuming  the  neuron  is  under  the  influence 
of  an  inhibitory  mean  field  network.  Recall  that  according  to  BCM,  monocular 
deprivation  leads  to  convergence  of  geniculocortical  synapses  to  a  state  where 
stimulation  of  the  deprived  eye  input  results  in  an  output  that  equals  zero  {£  =  0). 
However,  with  average  network  inhibition,  the  evolution  of  the  cell  to  this  state  does 
net  require  that  the  efficacy  of  deprived-eye  synapses  be  driven  completely  to  zero. 
Instead,  these  excitatory  synapses  will  evolve  to  a  state  where  their  influence  is  exactly 
offset  by  intracortical  inhibition.  Thus,  the  removal  of  intracortical  inhibition  in  this 
network  would  reveal  responses  from  otherwise  ineffective  inputs.  This  result  is  in 
accordance  with  the  experimental  observation  of  "unmasking"  of  synapses  when  the 
inhibitory  effects  of  GABA  are  antagonized  with  the  blocking  agent  bicuculline  (9). 

A  Possible  Physiological  Mechanism 

One  of  the  consequences  of  the  network  theory  discussed  in  the  previous  section  is 
that  the  experimental  results  obtained  in  visual  cortex  over  the  last  generation  can  be 
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explained  by  modification  of  excitatory  synapses,  with  minimal  changes  in  intracorneal 
inhibition.  The  balance  of  available  experimental  evidence  supports  this  conclusion 
For  example.  Singer  (29)  found  using  intracellular  recording  that  geniculocortical 
synapses  on  inhibitory  interneurons  are  more  resistant  to  monocular  deprivation  than 
are  synapses  on  pyramidal  cell  dendrites.  And.  recent  work  suggests  that  the  density 
of  inhibitory  GABAergic  synapses  in  kitten  striate  cortex  is  also  unaffected  by  MD 
during  the  critical  period  (30).  Taken  together,  these  theoretical  and  experimental 
results  indicate  that  the  search  for  mechanism  should  be  focused  on  the  excitatory 
synapses  that  impinge  upon  excitatory  cells  in  visual  cortex.  Interestingly,  this  type  of 
synapse  is  formed  exclusively  on  dendritic  spines,  a  feature  that  distinguishes  it  from 
other  types  of  cortical  synapse  (31 ).  This  suggests  that  experience-dependent 
modifications  in  striate  cortex  occur  primarily  at  axospinous  synapses. 

What  mechanisms  support  the  experience-dependent  modification  of  axospinous 
synapses?  Recall  that,  according  to  the  theory,  when  the  postsynaptic  cell  is 
depolarized  beyond  the  modification  threshold,  0m.  then  active  synapses  will  be 
strengthened.  Depolarization  beyond  0m  minimally  requires  the  synchronous 
activation  of  converging  excitatory  afferents.  When  postsynaptic  activity  fails  to  reach 
0M,  then  the  active  synapses  will  be  weakened.  The  identification  of  the  physiological 
basis  of  0m  is  therefore  central  to  an  understanding  of  the  modification  mechanism. 

Work  on  long-term  potentiation  (LTP)  in  the  hippocampal  slice 
preparation  has  provided  an  important  insight  into  the  nature  of  the  modification 
threshold  that  may  be  applicable  to  the  visual  cortex.  LTP  is  a  long-lasting 
increase  in  the  synaptic  strength  of  excitatory  afferents  that  have  been 
tetanically  stimulated  (32).  The  induction  of  LTP  depends  upon  the  coactivation 
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of  converging  excitatory  afferents  [input  cooperativity  (33)],  the  depolarization  of 
the  postsynaptic  neuron  (34).  the  activation  of  NMDA  receptors  (35),  and  the 
postsynaptic  entry  of  calcium  ions  (36).  A  current  working  hypothesis  is  that  the 
synchronous  tetanic  activation  of  converging  afferents  depolarizes  the  target 
dendrite  beyond  the  threshold  for  postsynaptic  Ca2+  entry  through  gates  linked 
to  the  NMDA  receptor  (37).  Elevated  dendritic  calcium  then  triggers  the 
intracellular  changes  that  lead  to  enhanced  synaptic  efficacy  (38). 

NMDA  receptors  are  a  subclass  of  excitatory  amino  acid  receptor,  and  glutamic 
acid  or  a  closely  related  subs'nnce  is  thought  to  be  the  transmitter  of  excitatory 
axospinous  synapses  at  many  locations  in  the  forebrain  (39).  These  receptors  are 
widely  distributed  in  the  cerebral  cortex,  including  the  visual  areas  (40).  It  appears  that 
NMDA  receptors  normally  coexist  postsynaptically  with  quisqualate  and/or  kainate 
receptors  (41 ).  The  "non-NMDA"  receptors  are  thought  to  mediate  the  classical 
excitatory  postsynaptic  potential  which  normally  results  from  electrical  stimulation  of 
axo-spinous  synapses  (35).  NMDA  receptors,  on  the  other  hand,  appear  to  be  linked 
to  a  membrane  channel  that  will  pass  calcium  ions.  Dingledine  (42)  first  reported  that 
NMDA  receptor  activation  leads  to  calcium  flux  only  when  the  cell  is  concurrently 
depolarized.  This  is  apparently  due  to  a  blockage  of  the  NMDA  channel  by  Mg2+  ions 
that  is  alleviated  only  when  the  membrane  is  depolarized  sufficiently  (43).  Thus, 
calcium  entry  through  channels  linked  to  the  NMDA  receptor  could  specifically  signal 
pre-  and  postsynaptic  coactivation  (44). 

Recently  Kleinschmidt,  Bear,  and  Singer  (45)  have  obtained  results  which  suggest 
that  NMDA-receptor-mediated  Ca2+  entry  also  contributes  to  the  synapse 
modifications  that  underlie  ocular  dominance  plasticity  in  striate  cortex.  Specifically, 
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they  have  found  that  intracortical  infusion  of  2-amino-5-phosphonovaleric  acid  (APV), 
a  selective  antagonist  of  the  NMDA  receptor  (46),  prevents  the  ocular  dominance  shift 
that  would  normally  occur  after  MD.  -  Moreover,  this  pharmacological  treatment  also 
resulted  in  a  striking  loss  of  orientation  selectivity.  These  data  support  Singer's 
hypothesis  that  dendritic  calcium  entry  is  a  crucial  variable  for  synaptic  modifications  in 
the  striate  cortex  (17). 

Our  theoretical  analyses  lead  us  to  suggest  several  refinements  of  the  Singer 
hypothesis.  Specifically,  we  propose  that: 

1)  0m  *s  the  membrane  potential  at  winch  NMDA  receptor  activation  by  sensory 

fiber  activity  results  in  dendritic  calcium  entry; 

2)  increased  calcium  flux  across  the  dendritic  spine  membrane  results 

specifically  in  an  increase  in  the  synaptic  gain; 

3)  activated  synapses  accompanied  by  no  postsynaptic  calcium  signals  will  be 

weakened  overtime. 

This  physiological  model  is  consistent  with  the  BCM  theory.  According  to  the 
model,  the  value  and  sign  of  0  is  determined  by  the  calcium  ion  movement  into 
dendritic  spines.  Synaptic  efficacy  will  increase  when  presynaptic  activity  evokes  a 
large  postsynaptic  calcium  signal  (0  >  0).  This  will  occur  only  when  the  membrane 
potential  exceeds  the  level  required  to  open  the  NMDA-receptor-activated  calcium 
channels  (g  >  8M).  When  the  amplitude  of  the  evoked  Ca2+  signal  falls  below  a 
certain  critical  level,  corresponding  to  0  =  0  and  g  =  0M,  then  active  synapses  will  be 
weakened  over  time.  Application  of  an  NMDA  receptor  blocker  theoretically  would 
increase  the  value  of  0^,  such  that  it  would  take  a  greater  level  of  depolarization  to 
achieve  the  critical  calcium  concentration.  In  accordance  with  the  experimental 
observations  of  Kleinschmidt  et  al.  (45),  the  theoretical  consequence  would  be  a  loss 
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of  orientation  selectivity  and  a  prevention  of  ocular  dominance  plasticity. 

.v 

Changes  in  synaptic  efficacy  that  depend  upon  postsynaptic  calcium  have  been 
observed  directly  in  Hermissenda  (47).  In  this  invertebrate,  a  classically  conditioned 
response  will  result  from  the  repeated  pairing  of  light  (the  conditioned  stimulus)  with 
rotation  of  the  animal  (the  unconditioned  stimulus).  The  crucial  modification  occurs  at 
the  level  of  the  "type  B"  photoreceptor  which  is  both  depolarized  by  light  and 
synaptically  activated  by  inputs  from  the  vestibular  system.  The  pairing  of  light  with 
rotation  depolarizes  the  cell  beyond  the  threshold  for  Ca2+  entry.  Elevated 
intracellular  Ca2+  leads  to  a  long-term  change  that  leaver  'l'e  cell  more  excitable  to 
light  than  before  conditioning.  In  this  case,  as  in  hippocampal  LTP,  postsynaptic 
calcium  entry  leads  specifically  to  an  increase  in  the  efficacy  of  the  active  synapses. 

Our  physiological  model  makes  no  statement  about  the  actual  locus  where  the 
modification  is  stored.  Ca2+  acts  as  an  intracellular  second  messenger  to  activate  a 
host  of  enzymes  including  protein  kinases  (48),  phosphatases  (49),  and  proteases 
(38).  In  Hermissenda  the  synaptic  efficacy  appears  to  be  increased  by  the  covalent 
modification  of  potassium  channels  in  the  postsynaptic  membrane  (47).  The  essential 
modification  that  underlies  LTP  in  the  hippocampus  is  still  controversial.  The 
candidates  range  from  alterations  in  the  morphology  of  dendritic  spines  (38)  to 
changes  in  the  amount  of  transmitter  released  presynaptically  (50).  The  weakening  of 
synapses  whose  activity  is  not  coincident  with  postsynaptic  calcium  entry  could  be 
explained  by  receptor  desensitization  (51).  Any  of  these  changes  could  contribute  to 
the  experience-dependent  modification  of  neuronal  response  properties  in  visual 
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However,  the  mode!  does  make  some  explicit  predictions  about  the  regulation  of 
the  calcium  messenger  system  that  is  linked  to  the  NMDA  receptors  on  cortical 
dendrites.  Recall  that  0^  depends  on  the  average  activity  of  the  cell.  If  the  average 
activity  decreases,  as  during  binocular  deprivation,  then  0W  decreases  and  it  should 
take  less  dendritic  depolarization  to  maintain  synaptic  efficacy.  One  way  this  could 
occur  in  our  model  would  be  to  alter  the  voltage  or  transmitter  sensitivity  of  the  NMDA 
receptors  with  the  result  that  less  synaptic  activity  (depolarization)  would  be  required 
to  evoke  the  necessary  calcium  signal.  It  is  well  documented  that  receptor 
supersensitivity  occurs  as  a  consequence  of  postsynaptic  inactivity  at  many  locations 
in  the  nervous  system  (52).  Alternatively,  a  weak  calcium  signal  could  br  nplified  at 
points  further  downstream;  for  example,  by  increasing  the  activity  of  calcium-activated 
enzymes. 

Dendritic  spines  obviously  play  an  important  role  in  this  model.  We  speculate  that 
these  postsynaptic  structures  are  specialized  to  isolate  high  levels  of  intracellular 
calcium.  The  morphological  organization  of  spines  appears  to  be  ideally  suited  for  this 
task.  Most  mature  spines  are  physically  separated  from  the  dendrite  by  a  narrow  neck, 
and  in  many  cases  contain  an  organelle  called  the  "spine  apparatus"  which  is  thought 
to  be  a  type  of  endoplasmic  reticulum  that  can  sequester  free  Ca2+  (53).  The  length  of 
the  spine  neck  may  be  constantly  changing  in  the  living  brain  (54),  but  electron 
microscopic  examination  has  led  repeatedly  to  the  conclusion  that  in  the  fixed  brain 
the  longest  spine  necks  on  cortical  pyramidal  cells  are  found  at  the  ends  of  apical 
dendrites,  while  the  shortest  spine  necks  are  a  consistent  feature  of  the  part  of  the 
dendrite  near  the  cell  body  (55). 


The  unusual  morphology  of  dendritic  spines  raises  some  interesting  questions  with 
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regard  lo  the  nature  of  NMDA  receptor  mediated  Ca2+  influx.  Numerous  modeling 
studies  have  shown  that  the  high  electrical  resistance  of  the  spine  neck  should  amplify 
the  depolarization  evoked  by  synaptic  activity  within  the  spine  head  (56). 

Consequently,  NMDA  activated  Ca2+  entry  should  occur  more  readily  in  spines  with 
longer  necks  (higher  resistance).  Synapses  on  a  spine  with  high  neck  resistance 
might  even  be  capable  of  evoking  significant  Ca2+  entry  without  concurrent  dendritic 
depolarization.  This  raises  the  possibility  that  the  modifiability  of  axospinous  synapses 
might  depend  on  spine  shape.  In  this  context,  it  is  interesting  to  note  that  total  light 
deprivation  leads  to  the  development  in  visual  cortex  of  truncated  spines  without  a 
constricted  neck  region  (57).  A  period  of  dark-rearing  is  also  known  to  leave  kitten 
striate  cortex  unusually  modifiable  by  visual  experience  (7). 


Conclusions 

We  have  presented  an  algorithm  for  synaptic  modification  that  reproduces  classical 
experimental  results  in  visual  cortex.  These  include  the  relation  of  cell  tuning  and 
response  to  various  visual  environments  experienced  during  the  critical  period:  normal 
rearing,  binocular  deprivation,  monocular  deprivation  and  reverse  suture.  A  molecular 
model  for  this  form  of  modification  has  been  proposed  based  on  the  NMDA  receptors. 
In  this  model  the  BCM  modification  threshold  0^  is  identified  with  the  voltage- 
dependent  unblocking  of  the  NMDA  receptor  channels.  A  consequence  of  this 
relationship  is  that  the  membrane  potential  at  which  Ca2+  enters  through  NMDA 
channels  should  vary  depending  on  the  history  of  prior  cell  activity. 


Stated  in  this  language  many  questions  become  of  obvious  interest.  Among  these 
are:  How  long  does  it  take  0M  to  adjust  to  a  new  average  firing  rate?  What  is  the 
molecular  basis  for  this  adjustment?  How  do  the  putative  global  modulators  of  corneal 
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plasticity,  such  as  acetylcholine  and  norepinephrine,  interact  with  the  second- 
messenger  systems  linked  to  NMDA  receptors  on  cortical  dendrites?  Can  we  provide 

A 

direct  evidence  that  those  cells  that  modify  are  or  are  not  those  acted  on  by  the 
modulators?  Are  the  known  morphological  features  of  dendritic  spines  causally 
related  to  the  modifiability  of  synaptic  strength?  Do  the  same  rules  apply  to 
reorganization  in  adults  as  apply  in  the  developmental  period? 

There  has  been  much  discussion  in  recent  years  about  possible  modification  of 
synapses  between  neurons  as  the  physiological  basis  of  learning  and  memory 
storage.  Molecular  models  for  learning  at  the  single-synapse  level  have  been 
presented  (11,  17,  38,  47,  58),  various  learning  algorithms  have  been  proposed  that 
show  some  indication  of  appropriate  behavior  (14,  24-26,  59)  and  a  mathematical 
structure  for  networks  of  neurons  is  rapidly  evolving  (60).  We  have  begun  a  concerted 
effort  to  unite  these  approaches,  and  believe  that  the  close  interaction  between  theory 
and  experiment  has  greatly  enriched  both  endeavors.  Theory  has  been  anchored  to 
experimental  observations  and  experiments  have  been  focused  onto  those  issues 
most  relevant  to  sorting  out  the  various  possible  hypotheses.  Further,  this  interaction 
has  enabled  us  to  pose  new  questions  with  precision  and  clarity  (61). 
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Figure  Legends 

s 

Fig.  1.  Representative  histograms  (from  ref.  5)  of  ocular  dominance  data  obtained  from 
the  right  striate  cortex  of  (A)  normal  cats  and  (B)  cats  that  were  monocularly  deprived 
early  in  life.  The  bars  show  the  percentage  of  neurons  in  each  of  the  seven  ocular 
dominance  catergories.  Cells  in  groups  1  and  7  are  activated  by  stimulation  of  either 
the  left  or  right  eyes,  respectively,  but  not  both.  Cells  in  group  4  are  activated  equally 
well  by  either  eye.  Cells  in  groups  2  and  3,  and  5  and  6  are  binocularly  activated,  but 
show  a  preference  for  either  the  left  or  right  eyes,  respectively.  The  histogram  in  (A) 
reveals  that  the  majority  of  neurons  in  the  visual  cortex  of  a  normal  animal  are  driven 
binocularly.  The  histogram  in  (B)  shows  that  a  period  of  monocular  deprivation  leaves 
few  neurons  responsive  to  the  deprived  eye. 

Fig.  2.  Illustrated  schematically  are  pyramidal  shaped  cortical  neurons  and  the 
proximal  segments  of  their  apical  dendrites.  The  shaded  circles  attached  to  the 
dendrites  represent  dendritic  spines.  In  the  first  stage  of  the  theoretical  analysis  we 
consider  only  the  inputs  to  the  cell  from  the  lateral  geniculate  nucleus  (A).  The  signals 
conveyed  along  these  afferents  arise  either  from  the  left  retina  (d1)  or  the  right  retina 
(dr)  and  are  transfered  to  the  cortical  neuron  by  the  synaptic  junctions  m1  and  mr.  The 
output  of  the  cortical  neuron,  as  measured  by  the  firing  rate  or  the  dendritic 
depolarization,  is  represented  as  £  which  is  the  sum  of  d1  •  m'  and  dr  •  mr.  The  central 
question  is  how  one  of  these  afferent  synapses,  nij.  modifies  in  time  as  a  function  of 
both  its  level  of  presynaptic  activity  £j  and  the  level  of  postsynaptic  depolarization  (B). 
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Fig.  3.  The  p  function  at  two  values  of  the  modification  threshold,  8M.  According  to 
BCM,  active  synapses  (d  >  0)  are  strengthened  when  p  is  positive  and  are  weakened 
when  0  is  negative,  p  is  positive  when  g,  the  postsynaptic  depolarization,  is  greater 
than  0M.  The  modification  threshold,  where  p  changes  sign,  is  a  non-linear  function  of 
the  average  activity  of  the  postsynaptic  neuron  (£).  Hence,  in  this  example,  0M  (1 ) 
would  be  expected  when  cortical  neurons  have  experienced  a  normal  visual 
environment  (A)  while  0M  (2)  would  result  from  a  prolonged  period  of  binocular 
deprivation  (B). 

Fig.  4:  In  the  second  stage  of  the  theoretical  analysis,  the  neurons  of  figure  2  are 
placed  in  a  cortical  network  in  which  the  inhibitory  and  excitatory  cells  receive  input 
from  the  LGN  and  from  each  other.  Illustrated  in  (A)  are  the  efferent  intracortical 
connections  of  two  neurons  in  the  network.  The  ith  neuron  is  excitatory,  the  gth  is 
inhibitory,  and  both  synapse  upon  every  other  cell  in  the  network.  Illustrated  in  (B)  are 
the  intracortical  inputs  to  the  i*h  neuron.  Thus,  in  addition  to  the  geniculate  afferents 
(d1  and  dr,  shown  in  figure  2a),  each  neuron  in  the  network  receives  excitatory  and 
inhibitory  intracortical  inputs.  In  a  network  generalization  of  equation  1 ,  the  integrated 

iL. 

output  of  the  r1  neuron  may  be  written: 

2j  =  mj1  *  d1  +  mjr  •  dr  +  X  Lj| 

where  the  term  X  Ly  £j  is  the  sum  of  the  output  from  other  cells  in  the  network 
multiplied  by  the  weight  of  their  synapses  on  the  ith  cell. 
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Table  1.  Parameters  identified  as  crucial  variables  for  synapse  modification. 


Parameter 

Possible'  measures 

Symbolic  notation 

Presynaptic 
activity  of  the 
jth  synapset 

Firing  rate; 
transmitter  release 
(millisecond  time  basett) 

dj 

Postsynaptic 

activity 

Firing  rate; 

dendritic  depolarization 
(millisecond  time  basett) 

£ 

Time  averaged 

postsynaptic 

activi; 

Firing  rate; 

dendritic  depolarization 
(minute  to  hour  time  basett) 

£ 

Synaptic  transfer 
function  of  the 
jth  synapset 

A Q  /  Adj 

mj 

"Global" 

modulation 

Dendritic  field  potentials; 
second  messenger  activity 

X.Y.Z 

t  The  notation  we  use  for  the  input  activity  of  a  single  LGN  fiber  and  its  synapse  weight 
is  jjj  and  mj,  respectively.  When  we  refer  to  the  total  input  activity  and  synaptic  weight 
of  an  array  of  fibers,  we  use  vector  notation,  d  and  m. 

ft  Time  bases  can  be  inferred  from  experimental  results,  d  and  q  are  averages  over 
approximately  500  milliseconds,  £  is  average  over  several  hours. 
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